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WHAT IS CLAIMED IS: 



1 LA method comprising: 

2 determining an orientation of a camera associated with a first image based on a shape 

3 of a perimeter of a corrected version of the first image, wherein the corrected version of 

4 the first image has less perspective distortion relative to a reference image than the first 

5 image and the shape of the perimeter of the corrected version of the first image is 

6 different from the shape of the perimeter of the first image; and 

7 projecting the first image on a surface based on the orientation of the camera 

8 associated with the first image. 

1 2. The method of claim 1 further comprising: 

2 determining a focal length of a camera associated with the first image based on the 

3 shape of the perimeter of the corrected version of the first images, wherein the step of 

4 projecting the first image is further based on the focal length. 

1 3 . The method of claim 1 , further comprising: 

2 projecting the reference image on the surface. 

1 4. The method of claim 3 further comprising: 

2 merging the projected reference image and the projected first image to form a 

3 panoramic image. 

1 5. The method of claim 3 further comprising: 

2 projecting a three-dimensional object onto the surface; 

3 merging the projected three-dimensional object, the reference image and the first 

4 image to form a panoramic image. 

1 6. The method of claim 1 wherein the surface is cylindrical. 

1 7. The method of claim 1 wherein the surface is spherical 

1 8. The method of claim 1 wherein the surface is planar. 



-23- 



Docket No.: 07844-46200 1/P426 



1 9. The method of claim 1 further comprising: 

2 determining an orientation of a camera associated with a second image based on a 

3 shape of a perimeter of a corrected version of the second image, wherein the corrected 

4 version of the second image has less perspective distortion relative to the reference image 

5 than the first image; and 

6 projecting the second image on the surface based on the orientation of the camera 

7 associated with the second image. 

1 1 0. The method of claim 2 wherein determining the focal length and rotation angle further 

2 comprises: 

3 selecting initial values for the orientation and the focal length; and 

4 improving the accuracy of the selected values of the orientation and the focal length 

5 by: 

6 estimating the shape of the perimeter of the corrected version of the first 

7 image based on the selected values of the orientation and the focal length; 

8 comparing the estimated shape and the actual shape of the perimeter of the 

9 corrected version of the first image; 

10 adjusting the selected values of the orientation and the focal length based on a 

1 1 difference between the estimated shape and the actual shape of the perimeter of the 

12 corrected version of the first image. 

1 11. The method of claim 1 0 wherein improving the accuracy of the selected values of the 

2 orientation and the focal length further comprises: 

3 computing a difference between the selected values of the orientation and the focal 

4 length with the adjusted values of the orientation and the focal length; 

5 if the computed difference is below a threshold value: 

6 determining that the adjusted values of the orientation and the adjusted value 

7 of the focal length are the actual orientation and the actual focal length; 

8 otherwise, if the computed difference is not below the threshold value: 

9 selecting the adjusted values of the orientation and the focal length as the 

10 values of the orientation and the focal length; and 
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1 1 repeating the step of improving the accuracy of the selected values of the 

12 orientation and the focal length. 

1 12. The method of claim 1 0 wherein the initial value of the orientation is selected to be an 

2 orientation of a camera associated with the reference image. 

1 13. The method of claim 1 , wherein the orientation of the camera associated with the first 

2 image is measured relative to an orientation of a camera associated with the reference 

3 image. 

1 14. The method of claim 1 0 wherein the initial value of the focal length is selected based on a 

2 measurement of the first image. 

1 15. The method of claim 14 wherein the selected initial value of the focal length is the sum of 

2 a length and a width of the image. 

1 16. The method of claim 10 wherein a Newton's iteration is used to adjust the initial values 

2 of the rotation angle and the focal length. 

1 17. The method of claim 1 wherein the orientation comprises a rotation angle of the camera. 

1 18. The method of claim 1 wherein the reference image is an image of a reference segment of 

2 a view and the first image is an image of a first segment of the view that overlaps the 

3 reference segment of the view, the method further comprising: 

4 correcting for perspective distortion in the first image relative to the reference image 

5 to generate the corrected version of the first image. 

1 1 9. The method of claim 1 8 further comprising: 

2 determining a position offset of the first segment of the view relative to the reference 

3 segment of the view, wherein correcting for perspective distortion is based on the 

4 determined position offset 

1 20. The method of claim 1 8 wherein the perimeter of the first image includes at least a first 

2 reference point and a second reference point and correcting for perspective distortion 
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alters the shape of the perimeter of the first image by moving the first reference point 
relative to the second reference point. 

21. The method of claim 20 wherein the first and second reference points are vertices defined 
by the shape of the perimeter of the first image. 

22. The method of claim 21 wherein the shape of the perimeter of the first image is 
rectangular and correcting for perspective distortion alters the shape of the perimeter of 
the first image into a trapezoid. 

23. The method of claim 1 wherein determining the orientation is further based on the shape 
of the perimeter of the first image. 

24. The method of claim 1 wherein the perimeter of the first image has the same shape as the 
perimeter of the reference image. 

25. An article comprising a machine-readable medium on which are tangibly stored machine- 
executable instructions the stored instructions being operable to cause a machine to: 

determine an orientation of a camera associated with a first image based on a shape of 
a perimeter of a corrected version of the first image, wherein the corrected version of the 
first image has less perspective distortion relative to a reference image than the first 
image and the shape of the perimeter of the corrected version of the first image is 
different from the shape of the perimeter of the first image; and 

project the first image on a surface based on the orientation of the camera associated 
with the first image. 

26. The article of claim 25 wherein the instructions further cause the machine to: 

determine a focal length of a camera associated with the first image based on the 
shape of the perimeter of the corrected version of the first images, wherein the step of 
projecting the first image is further based on the focal length. 

27. The article of claim 25 wherein the instructions further cause the machine to: 

project the reference image on the surface. 
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28. The article of claim 27 wherein the instructions further cause the machine to: 



2 merge the projected reference image and the projected first image to form a 

3 panoramic image. 

1 29. The article of claim 27 wherein the instructions further cause the machine to: 

2 project a three-dimensional object onto the surface; 

3 merge the projected three-dimensional object, the reference image and the first image 

4 to form a panoramic image. 

1 30. The article of claim 25 wherein the surface is cylindrical. 

1 31. The article of claim 25 wherein the surface is spherical. 

1 32. The article of claim 25 wherein the surface is planar. 

1 33. The article of claim 25 wherein the instructions further cause the machine to: 

2 determine an orientation of a camera associated with a second image based on a shape 

3 of a perimeter of a corrected version of the second image, wherein the corrected version 

4 of the second image has less perspective distortion relative to the reference image than 

5 the first image; and 

6 project the second image on the surface based on the orientation of the camera 

7 associated with the second image. 

1 34. The article of claim 26 wherein determining the focal length and rotation angle further 

2 comprises: 

3 selecting initial values for the orientation and the focal length; and 

4 improving the accuracy of the selected values of the orientation and the focal length 

5 by: 

6 estimating the shape of the perimeter of the corrected version of the first 

7 image based on the selected values of the orientation and the focal length; 

8 comparing the estimated shape and the actual shape of the perimeter of the 

9 corrected version of the first image; 

10 adjusting the selected values of the orientation and the focal length based on a 
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1 1 difference between the estimated shape and the actual shape of the perimeter of the 

1 2 corrected version of the first image. 

1 35. The article of claim 34 wherein improving the accuracy of the selected values of the 

2 orientation and the focal length further comprises: 

3 computing a difference between the selected values of the orientation and the focal 

4 length with the adjusted values of the orientation and the focal length; 

5 if the computed difference is below a threshold value: 

6 determining that the adjusted values of the orientation and the adjusted value 

7 of the focal length are the actual orientation and the actual focal length; 

8 otherwise, if the computed difference is not below the threshold value: 

9 selecting the adjusted values of the orientation and the focal length as the 

I o values of the orientation and the focal length; and 

I I repeating the step of improving the accuracy of the selected values of the 
12 orientation and the focal length. 

1 36. The article of claim 34 wherein the initial value of the orientation is selected to be an 

2 orientation of a camera associated with the reference image. 

1 37. The article of claim 25 wherein the orientation of the camera associated with the first 

2 image is measured relative to an orientation of a camera associated with the reference 

3 image. 

1 38. The article of claim 34 wherein the initial value of the focal length is selected based on a 

2 measurement of the first image. 

1 39. The article of claim 38 wherein the selected initial value of the focal length is the sum of 

2 a length and a width of the image. 

1 40. The article of claim 34 wherein a Newton's iteration is used to adjust the initial values of 

2 the rotation angle and the focal length. 

1 41 . The article of claim 25 wherein the orientation comprises a rotation angle of the camera. 
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42. The article of claim 25 wherein the reference image is an image of a reference segment of 



2 a view and the first image is an image of a first segment of the view that overlaps the 

3 reference segment of the view, the instructions further causing the processor to: 

4 correct for perspective distortion in the first image relative to the reference image to 

5 generate the corrected version of the first image. 

1 43. The article of claim 42 wherein the instructions further cause the machine to: 

2 determine a position offset of the first segment of the view relative to the reference 

3 segment of the view, wherein correcting for perspective distortion is based on the 

4 determined position offset 

1 44. The article of claim 42 wherein the perimeter of the first image includes at least a first 

2 reference point and a second reference point and correcting for perspective distortion 

3 alters the shape of the perimeter of the first image by moving the first reference point 

4 relative to the second reference point. 

1 45. The article of claim 44 wherein the first and second reference points are vertices defined 

2 by the shape of the perimeter of the first image. 

1 46. The article of claim 45 wherein the shape of the perimeter of the first image is rectangular 

2 and correcting for perspective distortion alters the shape of the perimeter of the first 

3 image into a trapezoid. 

1 47. The article of claim 25 wherein determining the orientation is further based on the shape 

2 of the perimeter of the first image. 

1 48. The article of claim 25 wherein the perimeter of the first image has the same shape as the 

2 perimeter of the reference image. 
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